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Using a sample of 232xl0 6 T(45) -> BB events collected with the BABAR detector at the PEP-II B-factory 
we study the decay B~ — > [i^ + 7r _ ]i)iC* _ where the X + 7r~ is either from a Cabibbo-favored D° decay or doubly- 
suppressed D° decay. We measure two observables that are sensitive to the CKM angle 7; the ratio R of the charge- 
averaged branching fractions for the suppressed and favored decays; and the charge asymmetry A of the suppressed 
decays: 

R = 0.046 ± 0mi(stat.) ± 0.008(syst.) 
A = -0.22 ± QM(stat.) ± 0A7(syst.). 
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Using a sample of 232 xlO 6 T(45) -» BB events collected with the BABAR detector at the PEP-II 
B-factory we study the decay B~ — » [K + -k~\dK*~ where the K + ir~ is either from a Cabibbo- 
favored D° decay or doubly-suppressed D° decay. We measure two observables that are sensitive 
to the CKM angle 7; the ratio R of the charge-averaged branching fractions for the suppressed and 
favored decays; and the charge asymmetry A of the suppressed decays: 

R = 0.046 ± 0.031(stat.) ± 0.008(syst.) 
A = -0.22 ± 0.6l(stat.) ± 0.17(syst.). 
PACS numbers: 13.25.Hw, 14.40.Nd 



An important feature of the standard model is that 
it accomodates CP violation through the Cabibbo- 
Kobayashi-Maskawa (CKM) quark mixing matrix V Q. 
The self consistency of this mechanism can be checked 
by overconstraining the associated unitarity trian- 
gle 0- In this paper we concentrate on the angle 
7= a,rg(-V ud V* b /V cd V* b ) by studying B-meson decay 
channels where b — > cus and b — > ucs tree ampli- 
tudes interfere. We use a technique suggested by At- 
wood, Dunietz and Soni |3J (ADS) where the final state 
B~ — > A' + 7r~ K* (892)~ can be reached from two ampli- 
tudes, B~ -> D°K*- followed by the doubly-Cabibbo- 
suppressed decay D° — > K + n~, and B~ — > D°K*~ fol- 
lowed by the Cabibbo-favored decay D° — > A + 7r~ Q. 
The size of the interference between these two ampli- 
tudes depends on the CKM angle 7 as well as the CP- 
conserving relative strong phases 6 b and —So, and the 
ratios tb and of suppressed and favored amplitude 
magnitudes in B- (A{B~ -> D°K*~) and A{B~ -> 
D°K*-)), and D- (.4(£>° -> A+tt") and A{D° -> 
A~7r+)) decays. We define two measurable quantities, 
i? and A, as follows: 



i? = 



A = 



T(B- 



[K+7T-] D K* 



r(B H 



[A-^+] D A*+) 



r(B- -► [A-tt+] d A*-) + T{B+ -> [K+tt-] d K*+) ' 
r(B~ -> [K+-k-] d K*-) - T(B+ -> [A-7r+] D A*+) 
T(B- -h. [A+tt-] d A*-) +T(B+ [K-ir+] D K*+y 



The notation [K + it~]d indicates that these particles are 
neutral Z?-meson (D°orD°) decay products. Neglecting 
the very small effect of D°D° mixing as justified in ref.[3j, 
R and A are related to 7, the strong phases, rg, and ro 
by 



• D 



r| + 2r D r B cos(S B + S D ) COS7, (1) 



R 



A = 2ruTB sui(Sb + Sd) sin j / R. 



(2) 



In the above equations only ro has been measured: 
r 2 D = 0.00362 ± 0.00029 0. Estimates for r B are in 
the range 0.1 < tb < 0.3 y5|- Because there are more un- 
knowns than measurable quantities, determining R and 
A does not uniquely determine 7. However, the R and 
A measured here can be used in combination with a sim- 
ilar technique proposed by Gronau, London, and Wyler 
(GLW) 6] to provide constraints on tb and eventually 7. 



Other methods sensitive to 7 0, Q rely on the analysis 
of three-body D° final states. 

This analysis uses data collected near the T(45) reso- 
nance with the BABAR detector at the PEP-II storage 
ring. The data set consists of 211 fb _1 collected at the 
peak of the T(AS) (232 xlO 6 BB pairs) and 20.4 ftr 1 
40 MeV below the resonance peak (off-peak data). 

The BABAR detector uses a five-layer double-sided sil- 
icon vertex tracker (SVT) and a 40-layer drift cham- 
ber (DCH) to measure the trajectories of charged parti- 
cles. Both the SVT and DCH are located inside a 1.5-T 
solenoidal magnetic field. Photons are detected by means 
of a CsI(Tl) crystal calorimeter also located inside the 
magnet. Charged particle identification is determined 
from information provided by a ring-imaging Cherenkov 
device (DIRC) in combination with ionization measure- 
ments (dE/dx) from the tracking detectors. The BABAR 
detector's response to various physics processes as well as 
varying beam and environmental conditions is modeled 
with GEANT4 based software. 

The decay B~ — > D°K*~ is reconstructed in final 
states where the K*~ decays to K®tt~ followed by A° — > 
7r + 7r~ and the D° decays into a charged kaon and pion. 
The analysis begins with the selection of K° candidates 
from oppositely charged tracks assumed to be pions. The 
invariant mass of the A° candidate is required to be 
within 10 MeV/c 2 (about three standard deviations) of 
the nominal K° mass 0. The K° s candidate is required 
to travel at least four times further than the standard de- 
viation of its decay length. Its flight direction and decay 
length must be consistent with those of a A° originating 
from the interaction point. The momentum of a K® can- 
didate meeting these criteria is then recalculated with a 
mass and vertex constraint. Next, a A° is paired with 
a charged track, assumed to be a pion, and the combi- 
nation is constrained to come from the interaction point. 
The pair is kept for further study if its invariant mass is 
within 55 MeV/c 2 of the nominal K* mass 0- Finally, 
since the K* from a B~ — > D°K*~ decay is polarized, 
we require | cos 6h \ > 0.4 where Oh is the angle in the K* 
rest frame between the daughter pion and the parent B 
momentum vector. This helicity-angle requirement helps 
discriminate B mesons from combinatorial background 
(mostly e + e~ — > qq continuum events; q S {«, d, s, c}) as 
the former have a cos 2 Oh distribution while that of the 
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latter is uniform. 

To perform the measurement, we reconstruct Cabibbo- 
favored D° — > K~tt + and doubly-Cabibbo-suppressed 
D° — > if + 7r~ candidates. Candidates that have an in- 
variant mass within 18 MeV/c 2 (2.5 standard deviations) 
of the nominal D° mass are kept for further study. We 
also select D° — > if~7r + 7r° and £>° — * If ~7r + 7r + 7r~ can- 
didates to define various signal distributions discussed 
later in this paper. Loose particle identification crite- 
ria are imposed on the charged particles of all studied 
decay channels. Pairs of photons with a total energy 
greater than 200 MeV and an invariant mass in the range 
125 < m 77 < 145 MeV/c 2 are combined to form 7r° candi- 
dates that are refit, with their invariant mass constrained 
to the nominal 7r° mass Q • Loose kinematic criteria are 
used to select the three- and four-body candidates. 

Suppression of backgrounds from e + e~ — > qq contin- 
uum events is achieved by using event shape and an- 
gular variables. Global event-shape variables are used 
to eliminate events with jet-like topology, a signature of 
e + e~ — > qq continuum events. The thrust angle of a 
B-meson candidate is required to satisfy |cos#t| < 0.9, 
where Qt is the angle between the thrust axis of the B- 
meson and that of the rest of the event. 

To further reduce the qq contribution to our data sam- 
ple a neural network (NN) is used. The variables used 
in the neural network consist of the angular moments L° 
and L 2 defined in Ref. [lOl. the ratio R 2 = H 2 /H of 
Fox- Wolfram moments [llj , the x 2 of the i3-meson ver- 
tex fit, the cosine of the angle between the B candidate 
momentum vector and the beam axis (cos#b), cos 6t 
(defined above), and the cosine of the angle between a 
D° daughter momentum vector in the D° rest frame 
and the direction of the D° in the f?-meson rest frame 
(cos 6 H (D )). The NN is trained with signal Monte Carlo 
events and continuum data collected below the T(45) 
(off-peak data). The NN is then cross-checked with an 
independent set of signal Monte Carlo events. Finally, 
we verify that the NN has a consistent output for off- 
peak data and qq Monte Carlo events. The separation 
between signal and continuum background is shown in 
Fig. n We select candidates with neural network output 
above 0.8. Our event selection is optimized to minimize 
the statistical error on the signal yield, determined using 
simulated signal and background events. 

We identify B-meson candidates using two nearly in- 
dependent variables that take advantage of the well 
defined beam energy and the known kinematics of 
T(4S) decay: the beam-energy-substituted mass to_es = 
yj (s/2 + p • pb) 2 /Eq — p 2 B and the energy difference 
AE = E* B — \fsj2 where the subscripts and B refer to 
the e + e~ system and i?-meson candidate, respectively; 
yjs is the e + e~ center-of-mass (CM) energy and the as- 
terisk labels the CM frame. The tties distribution for 
signal events is well represented by a Gaussian function 
with mean centered at the known mass of the B~ |2( 
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FIG. 1: The result of the neural network training and verifica- 
tion (see text). The training samples are shown as histograms. 
The signal (Monte Carlo simulation) is the shaded histogram 
peaking to the right; the background (off-peak data recorded 
40 MeV below the resonance) is the histogram with a peak 
near 0. The data samples used to check the NN are overlaid 
as data points. The vertical bar and the arrow indicate the 
requirement used to select signal candidates. 



and width 2.76 MeV/c 2 . The AE distribution for signal 
events is described by a Gaussian function centered at 
zero with a width that varies from 11 to 13 MeV among 
the different final states. These quantities are measured 
in the data from B~ — > D°K*~ with Cabibbo-favored 
D° decays. For this analysis signal events must satisfy 
\AE\ < 25 MeV. 

The efficiency to detect a B~ — ► D°K*~ signal event 
where D° — > Kw, after all criteria are imposed, is 
(9.6±0.1)%. This efficiency is the same for D° — > K~tt + 
and D° — > K + ir~ . There are multiple candidates in 12% 
of the events. In such cases the candidate with the small- 
est \AE\ is selected for further study. According to Monte 
Carlo simulation, this is the correct candidate 88% of the 
time. 

We study various potential sources of background us- 
ing a combination of Monte Carlo simulation and data 
events. Two sources of background are identified in large 
samples of simulated BB events. One source is D°K2.it~ 
production where the K®ir~ is non resonant and has an 
invariant mass in the K*~ mass window. This back- 
ground is discussed later in this paper. The second back- 
ground (peaking background) includes instances where 
a favored decay (i.e. B~ — > [K~it + ]dK*~) contributes 
to fake candidates for the suppressed decay (i.e., B + — > 
[K~tt + ]e>K* + ). The most common way for this to occur 
is for a ir + from the rest of the event to be substituted for 
the ir~ in the K*~ candidate. Other sources of peaking 
background include double particle-identification failure 
in signal events that results in D° — > K~tt + being re- 
constructed as D° — > ir~K + , or the kaon from the D° 
being interchanged with the charged pion from the K* . 
From a detailed Monte Carlo study the total size of this 
background is estimated to be 1.4±0.2 events. We also 
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verify with the Monte Carlo simulation that the charm- 
less decays with the same final state as the signal (e.g., 
B~ — > K*~ K~tt + ) are not a significant background for 
this analysis. 

Signal yields are determined from an unbinned ex- 
tended maximum likelihood fit to the rriES distribution 
in the range wies > 5.2 GeV/c 2 . A Gaussian function 
(Q) is used to describe all signal shapes while the com- 
binatorial background is modeled with an ARGUS 01 
threshold function(.A). This function's shape is deter- 
mined by one parameter £ while a second parameter, 
E max = y/s/2, (fixed at 5.2901 GeV/c 2 ) is the maxi- 
mum mass for pair-produced i?-mesons given the collider 
beams energies. For a probability distribution function 
(PDF) we use a ■ A + b ■ Q where a is the number of 
background events and b the number of signal events. We 
correct b for the peaking background previously discussed 
(1.4±0.2 events). The mean and width of Q and the value 
of £ are determined by an initial fit to all B~ — ► D°K*~ 
candidates where the D° decays into the Cabibbo- favored 
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FIG. 2: Distributions of toes for the wrong-sign (top) and 
right-sign (bottom) decays. These decay categories are de- 
fined in the text. The curves result from a simultaneous fit 
to these distributions with identical PDFs for both samples. 



In Fig. |21 we show the results of a simultaneous fit to 
B~ -> [K+tt-] d K*- and B~ -> [K-n+] D K*- candi- 
dates that satisfy all selection criteria. We call wrong- 
(right-) sign decays those where the K* and the kaon 




(GeV/c ) 



FIG. 3: Result of a simultaneous fit to the wrong-sign and 
right-sign 771es distributions with identical PDFs for both 
samples. Here the wrong-sign sample shown in the top plot of 
Fig- |U is split by charge to measure A. The upper plot shows 
the jties distribution of the B + — » [K~tt + ]dK* + decays while 
the lower plot presents the same for the B~ — > [K + -k~]dK*~ 
decays. The curves are the results of the fit. 



have opposite (same) strangeness. It is in the wrong-sign 
decays that the interference we study takes place. There- 
fore in Fig. 13 we display the same fit separately for the 
wrong-sign decays of the B + and the B~ mesons. The re- 
sults of the maximum likelihood fit are R — 0.046±0.031, 
A = -0.22 ± 0.61, and 91.2 ± 9.7 B~ -> [K'-k + ] d K*- 
right-sign events. Expressed in terms of the wrong-sign 
yield, the fit result is 4.2 ± 2.8 wrong-sign events. The 
errors are statistical only. The correlation between R and 
A is insignificant. 

In Table ^ we summarize the systematic errors rele- 
vant to this analysis. Since both R and A are ratios of 
similar quantities most potential sources of systematic 
errors cancel. The estimate for the detection-efficiency 
asymmetry is obtained from a sample of B~ — > D°ir~ 
events. Here a charge asymmetry of A c % = (— 1.9 ±0.8)% 
is measured. We add linearly the central value and one- 
standard deviation in the most conservative direction to 
assign a systematic error of 5A c h = ±0.027 to the A 
measurement. To a good approximation the systematic 
error in R due to this source can be shown to be given 
by 5R — R ■ A ■ 5A c h, with A the previously determined 
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central value. 

To estimate the systematic uncertainty on A and R 
due to the peaking background, we use the statistical 
uncertainty on this quantity ±0.2 events. With approx- 
imately 4 B~ — ► [K+tt-] d K*- events and 90 B~ -> 
[X^TT+J^iir* - events this source contributes ±0.002 and 
±0.043 to the systematic errors on R and A, respectively. 

To account for the non resonant K®tt~ pairs in the K* 
mass range we study a model that incorporates S-wave 
pairs in both the b — > cus and b — > ucs amplitudes. It 
is expected that higher order partial waves do not con- 
tribute. The amount of S-wave present in the favored 
b — ► cus amplitude is determined directly from the data 
by examining the angular distribution of the K®tt sys- 
tem in the K* mass region. To estimate the systematic 
errors due to this source we vary all strong phases within 
2n and calculate the maximum deviation between the 
S-wave model and the expectation if there were no non 
resonant contribution for both R (Eq. ^| and A (Eq. [3J . 
The result of this study is given in Table [I] 

In the fit to the rriES distribution we use parame- 
ters determined from an initial fit that includes D a — > 
K~ 7r + , i4T~7T + 7r° and i^ _ 7r + 7r + 7r~ candidates. We re- 
peat the fit using parameters from each individual D° 
decay channel and calculate a contribution to the system- 
atic error from the observed variations in R and A. We 
also vary E max by ±2 MeV, refit and add the maximum 
shifts in R and A to the previously described contribu- 
tion to obtain the systematic error associated with the 
shape of the tties distribution. After adding in quadra- 
ture the individual systematic error contributions listed 
m Table HI we find: 

R = 0.046 ±0.031(stat.) ±0.008{syst.), 
A = -0.22±0.61(stat.) ±0.l7(syst.). 

We also quote the results in terms of two other variables: 

R(l+A) = 0.036 ± 0.042 ±0.010, 
R(l-A) = 0.056 ±0.045 ±0.012. 

They may be of use in combining 7-sensitive measure- 
ments from the GLW and ADS methods, and the anal- 
yses exploiting three-body D° decays. The effect of the 
non resonant K®tt~ background gives the dominant con- 
tribution to the systematic uncertainties, ±0.009 on both 
quantities. 

In order to extract information on tb and 7 we combine 
the above measurements of R and A with measurements 
of similar quantities, Rcp±, Acp±, from B — > D^ p K*~ 
[l3| using the method suggested in Ref . [|| , in which the 
D° decays to CP eigenstates are exploited. A frcquentist 
statistical approach Q is used. A x 2 is formed from the 
differences between the measured and theoretical values, 
and the covariance matrix of the six measured variables. 
We restrict tb to values between and 1.3 and allow 



TABLE I: Summary of systematic uncertainties. 



Source 



SR 



8A 



Detection asymmetry ±0.0003 ±0.027 

Peaking background ±0.002 ±0.043 

Non resonant K°n~ background ±0.0073 ±0.126 
Shape of m E s distribution ±0.0023 ±0.108 



Total systematic error 



±0.008 ±0.174 
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FIG. 4: Constraints on r B , The BABAB. B~ -> D C pK*~ 
(GLW) LLal result is combined with this analysis. The dashed 
(dotted) curve shows 1 minus the confidence level to exclude 
the abscissa- value as a function of tb derived from the GLW 
(ADS) only measurements. When both the GLW and ADS 
results are combined the curve above the shaded area is ob- 
tained. Horizontal lines show the exclusion limits at the 1, 2 
and 3 standard deviation levels. 



7 to vary between and 180° for all possible values of 
(Sb + Sd) between and 360°. We call Xmin(= 1-0 the 
minimum \ 2 f° r t ne whole parameter space. We then 
scan the tb range: for each value of tb we minimize 
the \ 2 across the reduced parameter space (where tb 

to 



is fixed), and find Xm- We use Ax 
compute the confidence level of re assuming Gaussian 
uncertainties. Figure0]shows the confidence level result- 
ing from this rs scan. Combining the ADS and GLW 
results we find 

v — n oq+o.06 
r B - 0.28_ 10 . 

In a similar fashion, we show the confidence level for the 7 
scan in Fig.[3J The interval 75° < 7 < 105° is disfavored 
at the two-standard deviation level. 

In summary we present the first measurements of yields 
from B~ — * [K + tt~]e>K*~ decays. By exploring the be- 
havior of the likelihood function close to its maximum, 
we determine that the statistical significance for R to dif- 
fer from zero is at the two-standard deviation level. As 
seen on Fig. 0J this (ADS) result narrows the allowed rp 
range previously obtained with the GLW method |13| . 
The constraint the ADS method provides on 7 is weak 
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FIG. 5: 1 minus exclusion confidence level curve for 7 ob- 
tained from the BABAR B~ -> D C pK*~ (GLW) result com- 
bined with this analysis. The graphical conventions are de- 
scribed in the caption of Fig. 0] 



with the present data sample. 
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